Ideal Skill Set
- Data Engineering with good Data pipelines development experience
- Good Experience in Informatica IICS
- Very good Python and SQL programming
- Good knowledge of AWS technologies.
- Kafka Data Streaming and API experience
PURPOSE:
The Senior Data Engineer will design, code, test, and analyze software programs and applications. This includes researching, designing, documenting, and modifying software specifications throughout the production lifecycle.
POSITION RESPONSIBILITIES:
- Work with Product team to determine requirements and propose approaches to address users' needs
- Analyze requirements to determine approach/proposed solution
- Design and Build Solutions using relevant programming languages
- Thoroughly test solutions using relevant approaches and tools
- Conduct research into software-related issues and products
- Bring out-of-box thinking and solutions to address challenging issues
- Effectively prioritize and execute tasks in a fast-paced environment
EXPERIENCE AND QUALIFICATIONS:
- Strong verbal and written communication skills
- Demonstrate integrity and maturity, and a constructive approach to challenges
- Demonstrate analytical and problem-solving skills, particularly those that apply to Data Warehouse and Big Data environments
- Open minded, solution oriented and a very good team player
- Hands on experience in developing Data Lake and Data Warehouse and Data Marts
- Proficiency in SQL and Scripting (Unix sell scripts, Python)
- Hands on experience in data pipeline development using modern ETL tools specifically on Informatica PowerCenter, Informatica IICS
- Hands on experience in trouble shooting complex ETL and SQL problems
- Hands on experience in designing and building data pipelines in AWS cloud using S3, Lambda, API Gateway, RDS, Redshift, etc.
